Project Description

Project Description: The proposal aims at developing a software service interface for natural-like interaction of humans with PR2-type personal robots. Natural-like interaction will be considered for communication (a model of hand gestures will be established that allow many natural gestures to be interpreted by the personal robot) and emulation of human skills, routine tasks (extracting reusable task knowledge from visual observation of human gestures, learning operational activities from human demonstration). The proposal involves a number of sections which will be integrated in this software system: (i) Spatial and temporal modelling of communicative and manipulative gestures; (ii) Hand gestures analysis and recognition, based on multiple-image processing); (iii) Reusable task knowledge extractor from visual observation of human performance and action reproducer (human tasks emulator); (iv) Visual servoing controller for environmental motion fine tuning. The OpenCV library will be used for image processing; an open source library will be created for gesture modelling, analysis and recognition.